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Abstract 

This paper presents several types of evolutionary algorithms (EAs) 
used for global optimization on real domains. The interest has been 
focused on multimodal problems, where the difficulties of a prema- 
ture convergence usually occurs. First the standard genetic algorithm 
(SGA) using binary encoding of real values and its unsatisfactory be- 
havior with multimodal problems is briefly reviewed together with 
some improvements of fighting premature convergence. Two types of 
real encoded methods based on differential operators are examined 
in detail: the differential evolution (DE), a very modern and effec- 
tive method firstly published by R. Storn and K.Price [T7| . and the 
simplified real-coded differential genetic algorithm SADE proposed by 
the authors [11] . In addition, an improvement of the SADE method, 
called CERAF technology, enabling the population of solutions to es- 
cape from local extremes, is examined. All methods are tested on an 
identical set of objective functions and a systematic comparison based 
on a reliable methodology pQ is presented. It is confirmed that real 
coded methods generally exhibit better behavior on real domains than 
the binary algorithms, even when extended by several improvements. 
Furthermore, the positive influence of the differential operators due to 
their possibility of self-adaptation is demonstrated. From the reliabil- 
ity point of view, it seems that the real encoded differential algorithm, 
improved by the technology described in this paper, is a universal and 
reliable method capable of solving all proposed test problems. 

1 Introduction 

At present, genetic algorithms belong to the most modern and most popular 
optimization methods. They follow an analogy of processes that occur in 
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living nature within the evolution of live organisms during a period of many 
millions of years. The principles of genetic algorithms were firstly proposed by 
J. H. Holland [9j; the books of D. E. Goldberg [7] and Z. Michalewicz [TJJ are 
the most popular publications that deal with this topic. Genetic algorithms 
have been successfully used to solve optimization problems in combinatorics 
(see [H]) as well as in different engineering tasks, see for example [T2"l [T^ [To]. 

Unlike the traditional gradient optimization methods, genetic algorithms 
operate on a set of possible solutions ( "chromozomes" ) , called "population". 
In the basic scheme, chromozomes are represented as binary strings. This 
kind of representation seems to be very convenient for optimization problems 
in combinatoric area (e.g., the traveling salesman problem). Nevertheless, we 
usually deal with real valued parameters in engineering and scientific prob- 
lems. The mapping of real values onto binary strings usually used within 
standard genetic algorithms may cause serious difficulties. As a result, this 
concept of optimization leads to an unsatisfactory behavior, characterized by 
a slow convergence and an insufficient precision, even in cases where the pre- 
cision is especially in focus. Of course, the development of genetic algorithms 
has brought several proposals to solve these difficulties to optimize problems 
on real domains using binary algorithms. 

Another possibility is to develop a genetic algorithm (or other evolution- 
ary algorithm) that operates directly on real values [Hj. In this case, the 
biggest problem is how to propose genetic operators. One of them is to use 
so-called differential operators that are based on determining mutual dis- 
tances of chromozomes - which are real vectors instead of binary strings in 
this approach. 

This paper studies two evolutionary optimization methods based on dif- 
ferential operators with reference to the standard and improved genetic al- 
gorithms using binary encoding. In particular, the differential evolution pro- 
posed by R. Storn and K. Price [J71II] and the simplified real coded differential 
genetic algorithm [UJ [16] are examined in very details. 

Although the outstanding ability of genetic algorithms to find global op- 
tima of multimodal functions (functions which have several local extremes) 
is usually cited in the GA literature, it seems that both the binary genetic 
algorithms and the real coded ones tend to premature converge and to fall 
into local extremes, mainly in high dimensional cases. To fight this difficulty, 
we have proposed so-called CERAF method. 

As the reference, test results for binary encoded algorithms from the out- 
standing article of J. Andre, P. Siarry and T. Dognon [JJ were selected. These 
results come from two variants of binary GAs: the standard genetic algorithm 
and the version extended by several improvements that were documented in 
the same publication. The set of twenty test functions was used to classify 
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reliability and performance of individual methods. In particular, the reliabil- 
ity is defined as a probability of finding the global extreme of a multimodal 
function while the performance is measured by the convergence rate of an 
optimization method. Since this methodology is able to filter out the influ- 
ence of random circumstances we have used the same criteria to quantify the 
robustness and the efficiency of real encoded optimization methods. 

2 Binary coded genetic algorithm 

Although the present paper deals mainly with real encoded evolutionary 
algorithms, we present a brief description of binary genetic algorithms, their 
limitations and possible improvements for the sake of further reference. 

2.1 Binary encoding 

A binary genetic algorithms can be simply characterized by the binary en- 
coding of possible solutions and appropriate binary genetic operators. The 
traditional binary genetic algorithms represent possible solutions as binary 
strings, usually derived from a division of the investigated interval into a sev- 
eral sub-intervals with a specified, usually rather limited, precision. The fact 
that different bits in the binary string have different importance depending 
on their position in the string is the serious problem of this type of encoding. 
This disadvantage can be resolved by several improvements, see Section 12.31 
for particular examples and references to the literature. 

2.2 Scheme of genetic algorithm and genetic operators 

As the first step it is necessary to generate (in most cases randomly) the 
starting population of possible solutions that are assigned the values of the 
optimized (or so-called fitness) function. Then, the sequential loop is re- 
peated until a stopping criterion is reached: 

1. Create a prescribed number of new individuals (chromozomes) using 
genetic operators of crossing-over and mutation. 

2. Values of fitness function are assigned to new individuals. 

3. The population size is decreased to the original value using selection 
operator. 

In the following, we present a sketchy description of basic genetic opera- 
tors: 
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mutation - the principle of this operator is an alteration of one or more 
bits in the binary string [6J; a parameter which gives a probability of 
performing this operation with a certain chromozome, is introduced, 

crossing-over - this operator chooses two chromozomes, so-called parents, 
and then creates their two descendants (children) using the following 
operation: it selects a position inside the binary string and starting 
from this position exchanges the remaining parts of the two chromo- 
zomes (see Figured]). The individuals subject to crossing-over are se- 
lected by an appropriate sampling method, which is not neccesarilly 
identical to the selection method employed in the next step. 

selection - this operation selects the individuals that should "survive" into 
the next generation from the whole population. See, e.g., [21 E] for a 
comprehensive list of different variants of selection schemes. 
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Figure 1: Crossing-over operator. 



2.3 Improvements of the standard binary genetic al- 
gorithm 

A lot of improvements of the standard binary genetic algorithm that aim at 
suppressing the premature convergence have been proposed by different au- 
thors, starting from different encoding, e.g., the well-known Gray code [10J; 
proceeding with threshold genetic algorithm with varying mutation probabil- 
ity [5J. Another possibilities are various adaptations of the crossing-over and 
the mutation or an introduction of local, gradient-based operators such as 
gradient optimizer |3J or evolutionary gradient operator proposed in [15] . In 
particular, in the reference study [1] the authors performed the testing com- 
putations of the standard genetic algorithm extended by adaptive rescaling 
of the investigated area and by introducing the scale-factor. For the sake of 
clarity, a more detailed description of these improvements follows: 
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• the adaptive rescaling of investigated domain: the area where the method 
searches for the optimum is diminished into the regions around several 
best chromozomes; it makes possible to reach very good precision even 
if the division of investigated interval is rather rough because with the 
decreasing searched range the division becomes more and more refined, 

• introducing so-called scale-factor (SF) which influences selection of in- 
dividuals to be subject to the crossing-over; at the beginning the worse 
individuals gain higher probability and the better ones gain lower prob- 
ability contrary to the standard genetic algorithm; with successive gen- 
erations this parameters decreases and for the last generation the se- 
lection works in the same manner as for the standard version. 

2.4 Genetic algorithm testing methodology 

The methodology proposed in [1] minimizes an influence of random circum- 
stances and different power of the used computers. In particular, the com- 
putation is run 100 times for each function of the test set. The number of 
successful runs is then taken as the probability of the success (the compu- 
tation is considered to be successful if the difference between the best value 
found by the algorithm and the theoretical optimum is less than 1% of the 
optimum value, or a distance is less than 0.1 if the theoretical optimum is 
zero). If 500 generations pass and the optimum is still not reached, the com- 
putation is treated as a failure. For the cases where the amount of successful 
runs is greater than zero, the average fitness call number is also given. For 
the sake of completeness, we list a (corrected) set of twenty test functions 
in Appendix [X] while the results of the binary genetic algorithm testing are 
shown in Table HJ 

3 Differential evolution 

This section opens the main topic of the present work - a search for improve- 
ments of real coded genetic algorithms aimed at resolving the premature 
convergence. To this end, a thorough description of the differential evolu- 
tion, which is the stepping stone of our improvements, is presented. 

The differential evolution belongs to the wide group of evolutionary al- 
gorithms. It was invented as the solution method for the Chebychev trial 
polynomial problem by R. Storn and K. Price [T7]. It is a very modern and 
efficient optimization method essentially relying on so-called differential op- 
erator, which works with real numbers in natural manner and fulfills the same 
purpose as the crossing-over operator in the standard genetic algorithm. 
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Table 1: Comparison of results of investigated methods. SR = success rate, 
NFC = average number of function calls, iV = dimension of the problem, 
SBGA = Standard Binary GA, EBGA = Extended Binary GA, DE = Dif- 
ferential Evolution, SADE = Simplified Atavistic DE 

3.1 The differential operator 

The typical differential operator has the sequential character: Let CHi(t) be 
the i-th chromozome of a generation t 

CHi{t) = (ch a (t), ch i2 (t), . . . , ch m (t)), (1) 

where n is the chromozome length (which equals to the number of vari- 
ables of the fitness function in the real encoded case). Next, let A be a subset 
of {1,2,..., Then, for each j G A, 

ch i:j (t + 1) = chij{t) + Fx (ch pj (t) - ch qj (t)) 

1 It may be chosen randomly, for example. 
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+ F 2 (ch bestj (t) - ch i:j (t)) , 



(2) 



and for each j A 



chijit + 1) = chij(t), 



(3) 



where ch P j and ch q j are the j-th coordinates of two randomly chosen chro- 
mozomes and c/ibcstj is the j-th coordinate of the best chromozome in gener- 
ation t. F\ and F% are random coefficients usually taken from interval (0, 1). 

3.2 The differential evolution algorithmic scheme 

The differential evolution can be understood as a stand-alone evolutionary 
method or it can be taken as a special case of the genetic algorithm. The 
algorithmic scheme is similar to the genetic algorithms but it is much simpler: 

1. At the beginning the initial population is created (e.g., randomly) and 
the fitness function value is assigned to each individual. 

2. For each chromozome in the population, its possible replacement is 
created using the differential operator discussed above. 

3. Each chromozome in the population has to be compared with its pos- 
sible replacement and if an improvement occurs, it is replaced. 

4. Steps 2 and 3 are repeated until a stopping criterion is reached. 

As could be seen, there are certain different features in contrary to the 
standard genetic algorithm, namely: 

• the crossing-over is performed by applying the differential operator, 

• selection for crossing-over, e.g. by the roulette wheel method, is not 
performed; the individuals subjected to the differential operator are 
chosen purely randomly, 

• selection of the individuals to survive is simplified: each chromozome 
has its possible replacement and only the worse in terms of fitness is 
replaced, 

• the mutation operator is omitted. 
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3.3 Test computations 

The differential evolution was examined on previously introduced set of test 
functions as the binary encoded algorithms and using the same methodology. 
All computations were performed with identical parameters setting: 

F 1 = F 2 = 0.85 and A = {1,2, . . . ,n}. (4) 

The population size was set to pop = lOn for all examined functions. The 
results are presented in Table [TJ 

Comparing the results of the differential evolution to those reported in [TJ , 
several interesting findings are apparent. First, the differential evolution 
shows substantially better reliability solving the most difficult functions where 
even the extended binary genetic algorithm failed. Only for the Hartman 2 
function the result is unsatisfactory (only 16%). In all other cases the proba- 
bility of success is better than 70% and in 10 cases it reaches 100% (including 
Hose 45 and both Brown 1 and 3 functions, for which the extended binary 
genetic algorithm failed). On the other hand, for several functions, where 
the binary algorithm shows 100% success, the differential evolution rests at 
about 70-95%. 

Another effect that is evident from the comparison is the fact that the 
differential evolution is able to find a solution with the same precision much 
faster (for example, 52 fitness calls contrary to 784 fitness calls using the 
extended binary algorithm for the Fl function). We suppose that this im- 
provement is a consequence of the very good precision adaptability of the 
differential operators as all alterations of the chromozomes are determined 
from their mutual distances, see Figure [21 

4 Differential genetic algorithm SADE 

This method was proposed as an adaption of the differential evolution after 
relatively long time of development. Its aim was to acquire a method which 
is able to solve optimization problems on real domains with a high number 
of variables (it was tested on problems with up to 200 variables). This 
algorithm combines the features of the differential evolution with those of 
the traditional genetic algorithms. It uses the simplified differential operator 
and the algorithmic scheme similar to the standard genetic algorithm. 

4.1 The simplified differential operator 

The simplified version of the differential operator taken from the differential 
evolution is used for the same purpose as the crossing-over in the standard 
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genetic algorithm. Let (again) CHi(t) be the i-th chromozome in a genera- 
tion t, 

CHi(t) = (cM*), ch i2 (t), ch m (t)), (5) 

where n is the number of variables of the fitness function. Then the simplified 
differential operator can be written as 

chij(t + 1) = ch pj (t) + CR (ch qj (t) - ch rj (t)) , (6) 

where ch p j, ch q j and ch r j are the j-th coordinates of three randomly chosen 
chromozomes and CR is so-called cross-rate. Figure [2] shows the geometrical 
meaning of this operator. Due to its independence on j, this operator can 
be also rewritten in the vector form as 

CHi(t + 1) = CH p (t) + CR(CH q (t) - CH r {t)). (7) 
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Figure 2: Geometric meaning of the simplified differential operator 

4.2 The algorithmic scheme and the operators in detail 

Contrary to the differential evolution, the SADE method uses the algorithmic 
scheme very similar to the standard genetic algorithm: 
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1. 



As the first step, the initial population is generated randomly and the 
fitness function value is assigned to all chromozomes in the population. 



2. Several new chromozomes are created using the mutation operators - 
the mutation and the local mutation (their total number depends on 
the value of a parameter called radioactivity - it gives the mutation 
probability) . 

3. Another new chromozomes are created using the simplified differential 
operator as was described above; the whole amount of chromozomes in 
the population is now doubled. 

4. The fitness function values are assigned to all newly created chromo- 



5. The selection operator is applied to the double-sized population. Hence, 
the amount of individuals is decreased to its original value. 

6. Steps 2-5 are repeated until a stopping criterion is reached. 
Next, we describe the introduced operators in more detail: 

mutation - if a certain chromozome CHi(t) was chosen to be mutated, 
a new random chromozome RP is generated and the mutated one 
CHk(t + 1) is computed using the following relation: 



where MR is a parameter called mutation-rate, 

local mutation - if a certain chromozome was chosen to be locally mutated, 
all its coordinates are altered by a random value from a given (usually 
very small) range, 

crossing-over - instead of traditional cross-over, the SADE method uses 
the simplified differential operator described above^l, 

selection - this method uses modified tournament strategy to reduce the 
population size: two chromozomes are randomly chosen, compared and 
the worse is rejected. Therefore, the population size is decreased by one. 
This step is repeated until the population reaches its original size^|. 

2 Contrary to the binary genetic algorithm the real encoded method may generate chro- 
mozomes outside the given domain. In our implementation, this problem is solved by 
returning these individuals to the feasible domain boundary. 

3 Contrary to the traditional tournament strategy, this approach can ensures that the 
best chromozome will not be lost even if it was not chosen to any tournament. 



zomes. 



CH k {t + 1) = CHiit) + MR(RP - CHiit)) 
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The detailed description of the SADE method including source codes in 
C/C++ and the tests documentation for high-dimensional problems can be 
obtained from the article [TT] and the web-page [T6] . 

4.3 Testing and results 

The test computations were performed with the same functions and under 
the same circumstances as in all previous cases. The population size was 
set to pop = lOn, which is the same value inherited from the differential 
evolution. Another parameters were set, after several trial runs, to CR = 0.2 
and MR = 0.5, the local mutation range to 0.25% of the domain range of a 
corresponding variable and the radioactivity was considered 20%. The results 
are shown in Table [TJ 

Similarly to the differential evolution method, the SADE algorithm shows 
better behavior concerning the convergence rate and the reliability than bi- 
nary encoded methods. The overall reliability is even better than for the 
differential evolution, but for the more complicated problems, the number 
of the fitness calls is somewhat bigger, even several times. This is caused 
by different behavior of both methods from the character of the convergence 
process point of view. While the differential evolution covers relatively large 
area of the investigated domain during the whole process, the SADE al- 
gorithm tends to create a cluster of individuals at a limited sub-area that 
wanders through the domain. As a consequence, if the cluster is deadlocked 
in a local extreme, it is necessary to wait until the mutation gives a chance 
to escape to another sub-area with better values. Of course, the probability 
of this effect is very low and hence the algorithm must wait a long period of 
time. This effect causes much worse results for problems with a rather large 
number of local extremes. 

5 Improvement of the differential genetic al- 
gorithm to prevent the premature conver- 
gence - the CERAF method 

As already mentioned in the previous section, the SADE algorithm tends 
to create clusters of chromozomes, which rather quickly wander through the 
domain. This behavior somehow recalls gradient optimization methods, how- 
ever, with several differences: firstly, it operates with more than one possible 
solution at a time, therefore it is able to better locate the sub-area with the 
desired solution. Secondly, since the changes of individuals are determined 
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from their mutual distances, this method is able to adapt the step size to 
reach an optimal solution. 

However, each time this method is caught in a local extreme, it has no 
chance to escape unless a mutation randomly finds a sub-area with better 
values. But the probability of this effect is very small, especially for the high- 
dimensional problems. If the gradient optimization methods are applied, 
this case is usually resolved by so-called multi-start principle. It consists of 
restarting the algorithm many times with different starting points. Similarly, 
any type of a genetic algorithm could be restarted many times. Neverthe- 
less, the experience shows that there are functions with so-called deceptive 
behavior, characterized by a high probability that the restarted algorithm 
would fall again into the same local extreme rather than focus on another 
sub-area. 

Generally speaking, there are several solutions to this obstacle. All of 
them are based on the leading idea of preventing the algorithm from being 
trapped in the local extreme that has been already found and to force the 
algorithm to avoid all of these. As the most natural way, we tried some 
penalization that deteriorates the fitness function value in the neighborhood 
of all discovered local extremes. However, this approach did not approve itself 
- if the shape of a penalization function is not determined appropriately, new 
local extremes appear at the boundary of a penalization function activity 
area. 

As an alternative, the CERAF0 method has been introduced. It produces 
areas of higher level of "radioactivity" in the neighborhood of all previously 
found local extremes by increasing the mutation probability in these areas 
many times (usually we set this probability directly to 100%). The range 
of the radioactivity area (an n-dimensional ellipsoid) is set to a certain per- 
centage of the domain - we denotes it as RAD. The time of stagnation that 
precedes the markup of a local extreme and initiation of a radioactive zone 
is another parameter of the method. Similarly to the living nature, the ra- 
dioactivity in the CERAF method is not constant in time but decreases in an 
appropriate way: each time some individual is caught in that zone and mu- 
tated, the radioactivity zone range is decreased by a small valu^f) (for example 
0.5%); this recalls the principle of disintegration of a radioactive matter. The 
radioactive area never disappears completely, so the chromozomes can never 
find the marked local extreme again. 

Abbreviation of the French expression CEntre RAdioactiF - the radioactivity center. 
5 During the numerical experiments it turned up that the chromozomes created by the 
mutation parameter should not affect the radioactivity zone range. 
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5.1 The SADE algorithm extended by the CERAF 
method 

Hereafter, the algorithmic scheme of the SADE method is supplied with 
several steps of the CERAF method. It determines whether some individuals 
got into any of the discovered "radioactive zones" and if so, mutates them 
with a high level of probability. Moreover, when the algorithm stagnates too 
long, it declares a new radioactivity area: 

1. As the first step, the initial population is generated randomly and the 
fitness function value is assigned to all chromozomes in the population. 

2. Several new chromozomes are created using the mutation operators - 
the mutation and the local mutation (their total number depends on 
the value of a parameter called radioactivity - it gives the mutation 
probability) . 

3. Another new chromozomes are created using the simplified differential 
operator as was described above; the whole amount of chromozomes in 
the population is now doubled. 

4. If any radioactive zone already exists, each chromozome caught in a 
radioactive area is, with a high probability, subjected to the mutation 
operation. 

5. Depending on the number of chromozomes determined in the previous 
step, the ranges of radioactive zones are appropriately decreased. 

6. The fitness function values are assigned to all newly created chromo- 
zomes. 

7. The selection operator is applied to the double-sized population. Hence, 
the amount of individuals is decreased to its original value. 

8. The number of stagnating generations is determined and if it exceeds 
a given limit, the actual best solution is declared as the center of the 
new radioactive area. 

9. Steps 2-8 are repeated until a stopping criterion is reached. 

Extensive test computations have shown that this methodology can be 
considered as a universal technique capable of solving any multimodal opti- 
mization problem provided that the method that is running underneath (i.e. 
the algorithm that generates new chromozomes) has a sufficient ability to 
find new possible solutions. In our case, the SADE algorithm works as the 
"exploration" method. 
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5.2 Test computations results 

For the purpose of the algorithm performance testing, the same functions 
set was used. Also, all parameters of the SADE method rest at the same 
values as before. The CERAF method parameters were assigned the following 
values: RAD is a 1/4 of a domain range (for each variable) and the mutation 
probability inside the radioactive zones is considered 100%. The limit of 
stagnating generations was set to 1700 /pop; this simple heuristic formula 
seems to work well for a wide variety of problems. The results are given in 
Table [2] for the cases where the CERAF technology was activated. In all the 
others the results are the same as for the stand-alone SADE method. 



Test function 


Dimension 


Success rate % 


Fitness calls 


PShubertl 


2 


100 


2388 


PShubert2 


2 


100 


1014 


Shekell 


4 


100 


3942 


Shekel2 


4 


100 


3746 


Shekel3 


4 


100 


3042 


Hartman2 


6 


100 


15396 


Brownl 


20 


100 


137660 


F5n 


20 


100 


20332 


FlOn 


20 


100 


200136 


F15n 


20 


100 


31574 



Table 2: Results for the SADE/CERAF method. 

Several interesting facts are evident when comparing these results with 
the previous cases: 

• This method has reached the 100% success for all test functions. 

• In many cases the number of fitness calls is the same as for the single 
SADE algorithm; in those cases the CERAF technology was not even 
activated because the simple algorithm found the global extreme itself. 

• For the last (and the most complicated) functions F5n, FlOn and F15n, 
the success has been improved from 50 — 90% to 100%, however, at the 
cost of slowing down the computation. We consider indeed that the 
reliability of the method is of greater value than the speed. These are 
the cases when the algorithm extended by the CERAF method was 
able to continue searching even after the previous simple method has 
been caught in a local extreme hopelessly. 
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• In several cases the computation was even accelerated by the CERAF 
method, while the reliability was not decreased; in one particular case 
(the Hartman 2 function) the reliability was even increased from 67% 
to 100%. This may appear as a paradox, because the CERAF method 
needs long periods of stagnation and repeated optimum searching. The 
acceleration comes from the fact that the method does not have to wait 
until the random mutation hits an area with better values, but it is 
forced to start searching in a different location. 

6 Conclusions 

As we have assumed, the presented results of test computations show defi- 
nitely that for the optimization of multimodal but still continuous problems 
on real domains the evolutionary methods based on real encoding and dif- 
ferential operators approve themselves much better than traditional binary 
genetic algorithms, even when extended by certain improvements. The real 
encoded algorithms produced better results both in simple cases, where they 
have reached much better (several times) convergence rates as well as in the 
complicated cases, where the obtained results were very satisfactory from 
the reliability point of view, even for functions where binary algorithms have 
completely failed (e.g., the functions Brown 1, Brown 3 and Hose 45). 

The overall reliability-based comparison of all the tested methods is pro- 
vided in Table [3] (x marks the cases, where the success was better than 
95%). Note that the SADE algorithm extended by the CERAF technology 
have achieved the 100% success for all the test functions. The next inter- 
esting result is that the single SADE algorithm has approximately the same 
reliability as the binary algorithm extended by several, rather sophisticated, 
improvements. The reliability of a differential evolution is somehow fluctu- 
ating and the standard binary algorithm does not show satisfactory behavior 
except the most simple cases. 

Table H] shows the comparison of all methods from the convergence rate 
point of view (x marks the case, where the method reached the result at 
the shortest time). The differential evolution seems to be the most effective 
(the fastest optimization method). For other cases, the SADE method or 
its CERAF extended version were the fastest ones. As could be seen, the 
binary algorithm has never reached the best convergence rate with this test 
computations. 
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Brown3 
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X 


X 
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X 


X 


X 
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X 
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X 


X 


X 


X 



Table 3: Comparison of reliability. 
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A List of test functions 

• Fl: 

f(x) = 2(x - 0.75) 2 + sin(57ra; - 0.4tt) - 0.125 (9) 

where 

< x < 1 
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Table 4: Comparison of convergence rate. 

F3: 

5 

f(x) = -X!L7'sin[(j + l)x + j]] 
i=i 

where 

-10 < x < 10 

Branin: 

f(x, y) = a(y — bx 2 + cx — d) 2 + h(l — f) cos x + h 

where 

a = 1, 6 = 5.1/4tt 2 , c = 5/tt, d = 6, 
h=10,f = 1/8tt, -5 < a: < 10, < y < 15 
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Camelback: 



fix, y)=\4- 2.1x 2 + j J x 2 + xy + (-4 + 4y 2 )y 2 (12) 
where 

-3 < x < 3, -2 < y < 2 

Goldprice: 

f(x,y)= [ 1 + (x + y + 1) 2 (19 -14a: + 3a; 2 - Uy + 6xy + 3y 2 )] ■ 
[ 30 + (2a; - 3y) 2 (18 - 32a; + 12a; 2 + A8y - 36xy + 27y 2 )] 

(13) 

where 

-2 < x < 2, -2 < y < 2 

PShubert 1 and 2: 



f(x,y) 



|y^icos[(i + l)x + i]| ■ 

|^iC0s[(? + l)y + 2]| + 



- 1.42513) 2 + (y + 0.80032) 2 ] (14) 

where 

-10 < x < 10,-10 < y < 10, 

for PShubertl: = 0.5 
for PShubert2: (3 = 1.0 

Quart ic: 



where 
Shubert: 



4 2 2 

np r f % T It 

f^ = T-^ + To + T < 15 > 



-10 < x < 10,-10 < y < 10 



f(x,y)= |j^icos[(i + + • 

(X)icos[(i + l^ + i]} (16) 



.i=i 



where 



-10 < a; < 10,-10 < y < 10 
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Hartman 1: 

i=i 

where 







< Xi 


< 1, 


i=l,... 


,3 






= (zi, 


...,X 3 ),Pi = 


(Pn, 


• • • ,Pi3), 


0>i = (Ojl, 


. . . , a i3 ) 




Q>ij 




Ci 








1 


3.0 


10.0 30.0 


1.0 


0.36890 


0.1170 


0.2673 


2 


0.1 


10.0 35.0 


1.2 


0.46990 


0.4387 


0.7470 


3 


3.0 


10.0 30.0 


3.0 


0.10910 


0.8732 


0.5547 


4 


0.1 


10.0 35.0 


3.2 


0.03815 


0.5743 


0.8828 



Shekel 1,2 and 3: 



fr[ (x - ai) T (x - a,) + Ci 

where 

0<Xj< 10, 

for Shekell: m — 5, 
for Shekel2: m — 7, 
for Shekel3: m = 10 



2 










Ci 


1 


4.0 


4.0 


4.0 


4.0 


0.1 


2 


1.0 


1.0 


1.0 


1.0 


0.2 


3 


8.0 


8.0 


8.0 


8.0 


0.2 


4 


6.0 


6.0 


6.0 


6.0 


0.4 


5 


3.0 


7.0 


3.0 


7.0 


0.4 


6 


2.0 


9.0 


2.0 


9.0 


0.6 


7 


5.0 


5.0 


3.0 


3.0 


0.6 


8 


8.0 


1.0 


8.0 


1.0 


0.7 


9 


6.0 


2.0 


6.0 


2.0 


0.5 


10 


7.0 


3.6 


7.0 


3.6 


0.5 
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Hart man 2: 



/(si,...,*6) = -E*e~^= 1, * ( * i ~ W)a 



i=i 



where 



<Xj < l,j = 1,...,6 

X = (Xi, . . . ,X 6 ),Pi = (Pil,...,Pi6),Oi = (a»l,---,Oi6) 



i a 



1 10.00 3.00 17.00 3.50 1.70 8.00 1.0 

2 0.05 10.00 17.00 0.10 8.00 14.00 1.2 

3 3.00 3.50 1.70 10.00 17.00 8.00 3.0 

4 17.00 8.00 0.05 10.00 0.01 14.00 3.2 



i Pij 



1 0.1312 0.1696 0.5569 0.0124 0.8283 0.5886 

2 0.2329 0.4135 0.8307 0.3736 0.1004 0.9991 

3 0.2348 0.1451 0.3522 0.2883 0.3047 0.6650 

4 0.4047 0.8828 0.8732 0.5743 0.1091 0.0381 



Hose 45: 

where 

Brown 1: 

/(*) 

where 



/(*)= 2 -3lI** 
n - i=i 

x = (#i, . . . , x n ), < Xi < i, n = 10 



5>i - 3) 



ieJ 



+ 



E[10- 3 (^ - 3) 2 - (x* - x i+1 ) + e 20 ^-*^] 



J = {1, 3, ... , 19}, -1 < Xj < 4, 1 < % < 20, x = (xi, . . . , x 20 ) T 
Brown 3: 
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/(^) = E[(^ 2 ) ( ^ +1) + (^ +1 ) { ^ +1) ] 



i=i 



x = (xi, . . . , x 20 ) T , -1 < Xi < 4, 1 < i < 20 
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F5n: 

/(x) = (tt/20) • 

jlOsin 2 ^) + YXiVi ~ If ■ (1 + lOsin 2 ^ + 1))] + (y 20 - lpj) 
where 

x=(x 1 ,..., x 20 ) T , -10 < Xi < 10, Vi = 1 + 0.25(x i - 1) 

FlOn: 

f(x) = (tt/20) • 

|l0sin 2 (7rxi) + - X ) 2 • C 1 + 10sin 2 (7rx m ))] + (x 20 - 1)^4) 

where 

x = (xi, . . . , x 20 ) T , -10 < Xi < 10 

F15n: 

/(x) = (1/10) • 

{19 
sin 2 (37ra;i) + £[(x, " i)^ 1 + stn 2 {3nx i+1 ))] + (l/10)(x 20 - 1) 2 [1 + sin 2 (27rx 20 )] 
i=i 



(25) 



where 

x = (xi, . . . , x 20 ) T , -10 < Xi < 10 
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